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ABSTRACT 

Numerous  researchers  have  proposed  the  use  of  robotic  aerial  explorers  to  perform  scientific  investigation  of  planetary 
bodies  in  our  solar  system.  One  of  the  essential  tasks  for  any  aerial  explorer  is  to  be  able  to  perform  scientifically 
valuable  imaging  surveys.  The  focus  of  this  paper  is  to  discuss  the  challenges  implicit  in,  and  recent  observations 
related  to,  acquiring  mission-representative  imaging  data  from  a  small  fixed-wing  UAV,  acting  as  a  surrogate  planetary 
aerial  explorer.  This  question  of  successfully  performing  aerial  explorer  surveys  is  also  tied  to  other  topics  of  technical 
investigation,  including  the  development  of  unique  bio-inspired  technologies. 
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1.  INTRODUCTION 

The  high-level  of  mobility,  and  unique  observational  perspective,  afforded  by  aerial  vehicles  makes  them  potentially 
extremely  valuable  tools  for  conducting  robotic  planetary  science  missions.  However,  the  potential  of  these  aerial 
explorers  is  counterbalanced  to  some  degree  by  high  vehicle  development  costs,  concern  over  achieving  robust 
sustained  flight  in  unknown  or  uncertain  environments,  and  the  potentially  low  scientific  return-on-investment  because 
of  limited  powered-flight  endurance,  and,  in  many  cases,  inability  to  safely  land  or  takeoff  to  conduct  multiple  sorties. 

The  Intelligent  Aerial  Vehicle  (IAV)  project  problem  statement  is  therefore:  1.  How  to  develop  autonomy  tools  and 
vision-based  systems  to  robustly  fly  planetary  aerial  vehicle  missions,  and  2.  How  to  conduct  high  quality  science  (such 
as  to  search  and  find  the  subtle  evidence  of  water  and  past  or  current  life)  from  a  low-  to  mid-altitude  aerial  survey 
(which  in  the  case  of  a  Mars  airplane  over  Mars  is  also  flying  at  high  speed  to  maintain  sufficient  aircraft  lift).  Figure.  1 
shows  the  contrast  between  an  aerial  view  and  the  signs  of  life  that  exist  below. 


Figure  1.  -  The  Challenge:  Searching  for  subtle  signs  of  life  in  a  barren  landscape  from  the  air. 
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2.  FIELD  DEMONSTRATIONS 

The  aerial  survey  imaging  research  conducted  so  far  has  focused  around  science  field  demonstrations  using  an 
assortment  of  aerial  vehicles  at  Haughton  Crater,  Devon  Island,  Nunavut,  Canada,  a  well-documented  Mars-analog 
research  site1.  The  key  feature  of  the  site  is  a  10km  diameter,  20  million  year  old  impact  crater.  The  crater,  along  with 
mars-like  terrain  and  geology  make  this  a  captivating  site  for  planetary  explorers  and  scientists. 


Figure  2.  -  Haughton  Crater,  Devon  Island  Mars-Analog  Site  (a)  map,  (b)  satellite  view,  and  (c)  view  from  the  ground  (images 
courtesy  of  the  Haughton  Mars  Project) 


2.1.  Field  season  2002 

An  initial  demonstration  of  aerial  explorer  flight  at  Haughton  Crater  was  conducted  in  the  summer  of  2002.  A  small 
commercial  UAV  was  taken  to  the  Mars-analog  site  and  flown  over  a  number  of  geologically  interesting  stretches  of 
terrain  (Figure  3).  The  UAV  was  capable  of  being  controlled  from  the  ground  via  line-of-sight  radio  and  flown  through 
pre-programmed  GPS  waypoints.  This  initial  demonstration  was  primarily  for  site  familiarization  purposes  as  well  as 
acquiring  imaging  data  to  enable  the  development  of  vision-based  navigation  systems. 


Figure  3.  -  Summer  Field  Demo  2002:  (a)  Micropilot  UAV  and  (b)  typical  GPS  telemetry  from  Haughton. 


A  large  digital  aerial  video  set,  in  many  cases  with  embedded  GPS  coordinates,  was  acquired  over  several  geologically 
significant  features.  Important  geological  and  astrobiological  sites  were  imaged  with  UAV:  example  images  included 
dry  river  beds  (Figure  4.)  and  snowmelt  water  run-off  on  hillsides  (Figure  5).  In  each  of  these  cases,  analogs  with  Mars 
terrain  features  of  interest  were  established. 


Figure  4.  -  Dry  riverbed  (panoramic  image  formed  by  tight  banking  turns  -  0  and  180  deg.  azimuth  —  with  UAV). 


Figure  5.  —  Examples  of  hillside  water  runoff  from  snow  melt. 


2.2.  Field  season  2003 

Table  1  outlines  the  multiple  objectives  and  overall  test  plan  matrix  of  the  Haughton  2003  field  season.  In  particular, 
the  2003  flight- testing  complemented  and  extended  the  work  accomplished  in  the  2002  field  season.  For  the  2003 
season,  a  MLB  “Bat”  UAV  with  improved  navigational  and  camera  sensors  was  flown  (Figure  6). 

Table  1  -  Test  Plan  Matrix 


Objective 

Test  Plan 

1 .  Search  &  Find  Autonomy 

Assess  satisfactory  operation  of  UAV  with  GPS  waypoint  navigation.  Reproduce,  on  an  open 
plain  close  to  Base  Camp,  search  and  find  scenario  conducted  at  NASA  Ames  August  20024 

2.  Deriving  Scale  &  Feature 
Information 

Fly  a  series  of  remote-piloted,  or  autonomous  flights  at  3  or  more  UAV  altitudes  (100,  200,  400 
ft)  over  the  same  terrain  features.  Post-process  the  images  to  derive  a  qualitative  sense  of  the 
effect  of  altitude  on  feature  resolution,  scale,  and  three-dimensional  characteristics. 

3.  Assessing  Impact  of  Perspective 

Perform  three  series  of  remote-piloted,  or  autonomous,  flights  over  a  common  set  of  terrain 
features  of  interest.  First,  fly  alongside  a  range  of  hills  at  different  altitudes,  lateral  offset 
distances,  and  oblique  angles.  Second,  approach  hillsides  with  water-runoff  features  at  various 
oblique  angles.  Third,  perform  circling  flight,  at  different  altitudes,  around  discrete  terrain 
features  such  as  rock  formations  and  valley  networks. 

4.  Ground  Truth 

Perform  a  series  of  drop  probe  releases  and  post-process  the  data  to  assess  the  size  and  scale  of 
ground  features  during  descent. 

Figure  6  -  MLB  ‘BAT’  UAV  used  in  2003  Haughton  season. 


3.  TERRESTRIAL  AND  PLANETARY  AERIAL  SURVEYS 

It  is  important  to  consider  the  similarities  and  differences  between  aerial  imaging  surveys  conducted  by  terrestrial 
UAVs  and  by  future  planetary  aerial  vehicle  “explorers.”  Beyond  the  obvious  differences  in  design  features  between 
terrestrial  UAVs  and  planetary  aerial  vehicles,  there  are  also  operational  differences,  as  well  as  differing  levels  of 
vehicle  autonomy  required. 

Table  2  -  Differences  between  Terrestrial  and  Planetary  Aerial  Explorer  Imaging  Surveys 


Factors 

Terrestrial 

Planetary 

Survey  Patterns 

Grid  and/or  Spiral  Patterns;  i.e.  the  ideal  is 
an  exhaustive  coverage  of  prescribed 
search  area. 

Bio-inspired  search  and  find  patterns:  i.e.  “fox  and  mouse,”  intelligent 
random  walk,  follow  the  gradients,  etc4.  Alternatively,  straight  and  level 
flight  paths  (in  preferred  direction)  may  be  employed  for  early  missions. 

Navigation 

GPS  based.  Magnetic  compass. 

Non-GPS-based.  Vision-system  navigation  via  tracking  of  terrain 
features  of  interest.  Sun  (or  star,  or  planet)  compass  and  horizon 
tracking.  Altimeter  terrain  following  via  simple  heuristic  rules  or  digital 
maps. 

Flight  Speed  and 
Altitude 

Aircraft  can  fly  low  and  slow  if  required. 
Considerable  is  available  flexibility  in 
tailoring  speed  and  altitude  to  meet 
mission  and  imaging  requirements. 
Portions  of  mission  can  be  handed  off  to 
other  aerial  vehicles,  and  imaging 
platforms,  if  necessary,  to  further  optimize 
the  imagery  return. 

In  particular  for  Mars  flyers,  there  is  limited  flexibility  to  tailor  speed  and 
altitude  as  compared  to  terrestrial  aerial  vehicles.  Mars  aerial  explorers 
will  have  to  fly  fairly  fast  (Mach  >0.5)  in  order  to  sustain  adequate  lift  in 
the  thin  atmosphere  of  Mars.  This  complicates  imaging  surveys  for  Mars 
aerial  explorers,  i.e.  acquiring  high-resolution,  blur-free,  images  while 
flying  at  high  speed,  perhaps  at  low-altitude  in  somewhat  uncertain 
terrain. 

Flight  Endurance 

Long  endurance  flights  on  the  order  of 
tens  of  hours  achievable;  in-flight 
refueling  possible 

Most  estimates  of  Mars  flyers  have  endurances  on  the  order  of  minutes  to 
2-3  hours  at  most.  Similar  flight  endurances  are  likely  for  aerial 
explorers  for  other  planetary  bodies,  unless  a  means  is  devised  to  refuel 
or  recharge  the  vehicle  in-flight,  has  the  ability  to  take-off  and  land 
(likely  vertically),  and/or  is  capable  of  performing  dynamic  and  thermal 
soaring  for  a  portion  of  its  flight. 

Imagery  &  Real¬ 
time  Data 

Processing  and 
Handling 

High-resolution  and  multi- spectral  data 
can  be  transmitted  from  the  aircraft  via 
high-bandwidth  satellite  relays  or 
transported  back  to  the  launch  or  recovery 
site 

Post  fight  survivability  (to  be  able  to  effect  a  “soft  crash”)  leading  to 
periodic  uplink  of  imagery  data  to  orbiter  or  directly  to  Earth  will  be 
required  for  the  gigabytes  of  data  acquired  for  an  aerial  explorer  mission. 

Support  Assets 

Satellite  telecom.  Ground  stations. 

Telecom  and  navigation  relays.  Launch 
and  recovery  site  assets. 

Only  limited  availability  at  best;  addition  of  orbiter  significantly  increases 
mission  cost;  pre-existing  orbiter  assets  from  earlier  missions  might  be 
available. 

Multiple  Sorties 

Yes. 

No  -  unless  multiple  aerial  explorers  are  employed  and/or  explorers  with 
vertical  lift  (hover,  vertical  take-off  and  landing)  capability  are  used. 

Robotic  “Ecology” 

Can  be  flown  as  a  single  unit,  or  part  of  a 
“system  of  systems”  network 

It  is  a  necessary,  but  not  a  sufficient,  mission  objective  that  an  aerial 
explorer  perform  high-quality  aerial  imaging  surveys.  It  is  likely  that 
such  vehicles  will  have  to  release  drop  probes  and  other  sensors  (passive 
as  well  as  “intelligent”),  as  well  as  work  in  cooperation  and  coordination 
with  other  robotics  assets  in  a  kind  of  “ecology.” 

4.  TERRAIN  FEATURES  OF  INTEREST 

In  conducting  the  aerial  surveys  of  the  Haughton  Crater,  Mars-analog  site,  it  was  essential  to  not  only  identify  what 
needed  to  be  accomplished  in  the  fixed-wing  UAV  flight  demonstrations.  It  was  equally  important  to  identify  the  areas 
for  over- flight  during  the  demonstrations  that  contained  scientifically  valuable  terrain  features  of  interest.  Table  3  lists 
several  of  those  key  features. 


Table  3.  -  Mars- Analog  Features  of  Interest 


Feature 

Location 

Reason  for  Interest 

Longitude,  Latitude 

Dry  River  Beds 

Launch  site  GPS  Coordinates: 

N  75.389319  W  89.872469 
Camera  Angle  ~35  Deg. 
downward. 

Through  telescopic  and  planetary  probe  evidence,  Mars  appears  to 
have  had  in  the  remote  past,  at  least,  periods  where  large  bodies  of 
surface  water  and  possibly  massive  flooding  existed.  The  ability  of 
aerial  explorers  to  identify  ancient  surface  features  indicative  of  the 
existence  of  past  water  is  paramount. 

Snow-Melt  Water  Run-off  on 
Hillsides 

N  75-26.135  W  89-51.605 
(Near  Base  Camp) 

Camera  angle  ~45  Deg. 
downward 

There  is  limited,  and  controversial  evidence,  that  water  run-off  on  the 
rim  of  craters  and  hillsides  on  Mars  may,  even  to  this  day,  may  be 
occurring  and  forming  features  such  as  “gullies.”  One  line  of 
thinking  gaining  acceptance  among  planetary  scientists  is  that  these 
gullies  are  forming  as  a  result  of  seasonal  snowmelt  run-off.  Devon 
Island  has  many  examples  of  such  snowmelt  run-off  features,  and, 
again,  it  is  imperative  that  an  aerial  explorer  be  able  to  identify  and 
locate  such  features. 

“Fortress”  Rock  Formation 

N  75-. 25. 980  W  89-51.240 

Near  Base  Camp  Runway. 

Isolated  rock  formation  with  considerable  surface  geological  detail. 
Excellent  test  case  for  extracting  three-dimensional  characteristics 
from  sequential  aerial  survey  images. 

Hamilton-Sundstrand  Rock 

N  75-26.765  W  89-52.258 
Located  in  the  middle  of  Von 
Braun  Planitia. 

Excellent  example  of  the  “blue  rock”  planetary  science  scenario, 
wherein  tiny  almost  indistinguishable  signs  of  evidence  are  found  in  a 
wide  expanse  of  barren  sterile  terrain.  Almost  unnoticed  on  the  top  of 
the  Hamilton-Sundstrand  rock  is  a  tiny  patch  of  reddish  orange  arctic 
flora.  The  rock  itself  is  a  lone  formation  in  a  wide  barren  plain. 
Again,  this  is  an  excellent  test  case  of  finding  discrete  noteworthy 
features  -  the  rock  itself  and  then  even  more  subtlety  the  orange 
lichen  —  in  nearly  featureless  aerial  survey  information. 

“Marine  Peak” 

N  75-26.826  W  89-54.225 

Marine  Peak  is  an  example  of  a  hillside  with  snowmelt  run-off. 

“Pete  Conrad”  Valley 

N  75-  25.826  W  89-54.213 

A  small  valley  network  with  noteworthy  rock  formation.  An 
excellent  test  case  for  extracting  three-dimensional  surface  features 
from  aerial  survey  images.  Additionally,  this  valley  network  reveals 
several  water  flow  features,  including  a  modest  riverbed  with  limited 
snowmelt  water  flow  on  one  side  of  the  valley  network.  The  steep 
rock  formations  surrounding  the  Pete  Conrad  Valley  illustrate  an 
important  point  about  using  aerial  explorers  to  gain  access  to  sites 
with  rugged  terrain,  as  well  as  deriving  unique  viewpoints  or 
perspectives  to  analyze  the  terrain  features  of  interest. 

In  the  future,  additional  sites  will  hopefully  be  examined  using  over  flights  including:  plains,  canyons,  valleys,  gullies 
formed  from  snowmelt,  Haughton  crater  itself,  ejecta  blocks,  and  sites  of  thermal  vent  water  seepage. 


5.  SEARCH  AND  FIND 

The  first  goal  of  the  small,  fixed-wing  UAV  field  demonstrations  conducted  at  the  Haughton  Crater,  Devon  Island  site 
was  to  perform  simulated  aerial  explorer  “search  and  find”  missions  using  bio-inspired  search  strategies  and  vehicle 
autonomy  software  based  on  “flight  behavior”  modeling2'4. 

Beyond  the  broad  scope  of  a  Mars  aerial  vehicle  mission  which  must,  in  large  part,  be  the  often-noted  mantras  of 
“follow  the  water”  and  “search  for  life,”  what  exactly  would  an  aerial  explorer  be  looking  for,  and  how  would  it  go 
about  doing  it?  The  answers  to  these  questions  have  important  implications  as  to  the  imaging  approach  taken  for  an 
aerial  explorer. 


Testing  at  NASA  Ames  research  Center  and  at  the  Haughton  Crater  Mars-analog  site  has  focused  on  the  use  of  bio¬ 
inspired  “search  and  find”  flight  behaviors  and  the  use  of  a  simple  vision-system  to  recognize  an  “orange  tarp”  that  acts 
as  a  simple  sensor  trigger  to  define  discovery  of  a  terrain  “feature  of  interest.”  As  more  sophisticated  and  lightweight 
vision- systems  and  sensors  become  available,  they  can  be  incorporated  into  the  UAV  flight  behavior  modeling.  Figure 
7  shows  a  generic  grid  pattern  search  strategy  with  the  uplink  and  downlink  interfaces  required  to  search  for  a  target 
(orange  tarp)  within  the  confines  of  Moffett  Field  Federal  Airstrip.  Upon  discovery  of  the  orange  tarp  (both  during 
testing  at  Ames  and  at  Haughton  Crater)  a  small  camera  drop  probe  is  deployed  over  the  coordinates  of  the  tarp  (Figure 
8.).  Wireless  video  provides  a  means  of  acquiring  ground  truth  of  the  feature  of  interest  site,  as  well  as  enabling  in  a 
global  sense  the  “calibration”  of  aerial  imagery  to  the  ground  images. 
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Figure  7.  -  Schematic  of  October  2002  flight  demonstration. 


Figure  8.  -  Video  drop  pod  and  parachute. 


The  release  of  a  camera  drop  probe  (or  other  air-deployed  sensor)  is  consistent  with  earlier  work2’3  examining  Mars 
aerial  explorer  mission  scenarios  in  light  of  biological  reproduction  strategies  found  in  nature.  In  effect,  the  release  of 
the  camera  drop  probe  reflects  analogously  the  dissemination  strategy  associated  with  the  so-called  r  &  K  survivorship 
types  embodied  by  some  living  creatures. 


Figure  9.  -  r  &  K  Mission  Scenario  Strategy  Demonstration  (Orange  Tarp  Analogous  to  Lichen  on  the  Hamilton- Sundstrand  rock 

located  on  the  Von  Braun  Planitia). 


Figure  10.  -  Ground  (360°)  Panoramic  Image  of  the  Von  Braun  Planitia 


In  the  case  of  the  Devon  Island  demonstrations,  a  single  drop  probe  is  released  over  a  terrain  feature  of  interest  (an 
orange  tarp  near  the  isolated  Hamilton  Sundstrand  rock)  that  has  active  biological  implications  (existence  of  a  small 
patch  of  orange  colored  lichen)  in  the  middle  of  a  largely  barren  and  featureless  Von  Braun  Planitia  (“plain”).  Figures  9 
and  10  show  images  of  the  Haughton  demonstration  and  flight  environment. 

6.  A  QUESTION  OF  SCALE 

An  image  without  context  is  nearly  worthless  in  terms  of  scientific  value.  A  field  scientist,  or  planetary  science 
researcher,  needs  to  understand  the  scale  and  context  in  which  the  aerial  image  data  were  gathered.  A  key  part  of 
establishing  the  context  of  the  aerial  images  is  acquiring  a  qualitative,  and  ideally  quantitative,  sense  of  “ground  truth” 
about  the  terrain  over  which  the  aerial  vehicle  is  flying.  Scientists  establish  ground  truth  at  relatively  accessible 
terrestrial  sites  by  gathering  photographic,  spectral,  and  contact  data  (Figure  11). 


Fig  11.  —  Several  Different  Scales  of  “Ground  Truth”.  Fifty,  five,  and  one  half  meter(s)  from  a  rock  near  the  Fortress. 


It  is  also  important  to  ask  how  to  perform  good  science  while  employing  aerial  explorers,  whether  for  field  science  in 
extreme  terrestrial  environments  or  for  planetary  science  missions.  It  is  essential  to  complement  aerial  imaging  data  at 
low  to  moderate  flight  altitudes  with  “ground  truth”  images.  Establishing  ground  truth  from  an  aerial  explorer  on  Mars 
is  an  entirely  different  challenge.  One  possible  strategy,  as  previously  applied,  is  the  deployment  of  camera  sensor  drop 
probes  from  the  aerial  vehicle  (Fig.  12).  The  two  sets  of  images  (from  the  aerial  vehicle  and  from  the  drop  probes) 
complement  each  other  and  provide  a  calibrated  viewpoint  of  high  value  features  of  interest  on  the  planetary  surface 
(substituting  if  you  will  a  geologist  or  biologist’s  eyes).  This  “calibration”  will  enable  improved  interpretation  of 
surface  images  from  the  aerial  survey  imaging  data,  even  for  over-flight  areas  where  drop  probes  are  not  released.  Drop 
probes  with  wireless  video  cameras  have  been  demonstrated  numerous  times  at  NASA  Ames  as  well  as  the  Haughton 
Crater. 

Figure  12  is  an  illustrative  set  of  images  from  a  drop  probe  release  near  the  Hamilton- Sundstrand  rock  located  on  an 
ancient  dry  lakebed  in  the  middle  of  the  Von  Braun  Planitia.  The  deployment  of  the  drop  probe  was  triggered  by  the 
recognition  of  the  orange  tarp  located  near  the  isolated  boulder.  The  emergence  of  detail  in  the  terrain  features  as  the 
probe  descends  is  notable  in  figure  12.  The  images  from  the  drop  probe  also  serve  to  illustrate  several  problems.  First, 
as  the  probe  lacked  a  swivel  in  the  parachute  rigging,  there  is  a  large  amount  of  frame-by-frame  rotation  in  the  images. 
Second,  as  there  was  a  significant  steady  crosswind  at  the  drop  probe  release  site,  the  probe  traveled  a  considerable 
distance  downwind  from  its  release  -  and  the  orange  tarp.  These  problems  can  be  corrected  or  accounted  for  in  future 
generations  of  drop  probes.  Aerial  explorers  employing  drop  probes  with  cameras  and  other  instruments  remain  a 
powerful  combination  that  can  provide  an  essential  element  of  context  and  relative  scale  which  is  unavailable  to  aerial 
survey  images  alone. 


Fig  12.  -  Drop  Probe:  (a)  UAV  downward-pointing  camera,  (b)  probe  midway  through  descent,  (c)  close  to  ground  contact,  and  (d) 

probe  on  ground 

Other  approaches  that  might  be  taken  to  assess  scale  and  overall  context  include:  maneuvering  the  aircraft  to  gain  a 
unique  and  improved  view  of  a  feature  of  interest,  such  as  flying  low  and  slow  (Fig.  13),  and  flying  over  man-made 
artifacts  (Fig.  14).  Even  for  aerial  explorers  on  Mars  a  case  can  be  made  to  acquire  aerial  images  of  artifacts  on  the 
ground  such  as  rovers  and  landers. 


Figure  13.  -  Different  scales  and  context  as  determined  by  progressively  flying  lower  and  slower  over  and  landing  on  a  dry  riverbed. 


Figure  14.  -  (a)  Haughton  base  camp  with  “Fortress”  in  background  and  (b)  “tent  city”  with  lee-side  of  Pete  Conrad  Valley  in  far 

background. 

Landing  is  not  an  option  for  Mars  aerial  explorers.  A  “soft”  crash  where  the  data  storage  and  telemetry  devices  survive 
is  the  best  scenario  to  strive  to  achieve.  All  aerial  explorers  will  ultimately  come  to  ground,  and  a  robust  design  that 
allows  for  data  transmittal  beyond  the  termination  of  flight  should  be  a  desirable  goal.  In  that  case,  images  such  as 
Figure  13  should  be  anticipated  and  accounted  for  in  mission  planning. 

7.  A  QUESTION  OF  PERSPECTIVE 

In  addition  to  providing  improved  resolution  images  of  planetary  surface  terrain,  as  compared  to  satellite  imagery,  an 
aerial  vehicle  can  also  provide  unique  viewpoint  perspectives  of  that  terrain.  Figure  15  illustrates  a  qualitative 
comparison  of  an  aerial  perspective  of  the  “Fortress”  rock  formation  near  the  Haughton  Crater  base  camp  versus  ground 
images  from  all  four  quadrants  of  the  same  formation.  The  aerial  images  were  taken  with  a  900  MHz  wireless 
downward-pointing  video  camera  using  a  fisheye  lens  flying  at  100  ft.  AGL  (above  ground  level).  Figure  16  is  a 
compiled  mosaic  of  aerial  images  from  the  same  aerial  video  as  shown  in  Fig.  15.  Aerial  imagery  offers  a  balance  of 
detail  and  overview  that  is  unavailable  from  either  space  or  ground.  In  many  cases,  the  intermediate  perspective  may  be 
the  most  valuable  and  well  worth  the  use  of  a  short  lived  asset  such  as  a  planetary  aerial  explorer. 


Figure  15.  -  Aerial  perspective  vs.  images  from  the  ground  (all  four  quadrants);  “Fortress”  rock  formation  on  Devon  Island. 


Figure  16.  -  Aerial  image  mosaic  of  Fortress  rock. 


Figure  17.  -  Simulated  rover  trek  through  “Pete  Conrad”  Valley. 


Figure  18.  -  Aerial  image  mosaic  of  a  portion  of  Pete  Conrad  valley. 

The  fundamental  assumption  underlying  all  planetary  aerial  vehicle  concepts  is  that  they  provide  a  unique  and 
scientifically  valuable  perspective  to  planetary  science  in  contrast  with  imaging  from  rovers  and  landers.  Figure  17 
shows  representative  images  for  a  simulated  rover  trek  through  Pete  Conrad  valley  using  a  camera  mounted  on  an  All 
Terrain  Vehicle  (ATV).  This  was  not  an  easy  excursion  for  relatively  inexperienced  ATV  riders,  and  would  be  difficult 
as  well  for  rovers  to  traverse.  As  a  counterpoint  to  the  simulated  rover  perspective,  Fig.  18  shows  a  mosaic  composite 
of  aerial  images  that  were  acquired  by  flying  multiple  circling  over- flights  of  the  upper  region  of  the  Pete  Conrad  valley 
(50-100ft  AGL  using  a  fish  eye  lens). 


8.  A  QUESTION  OF  BANDWIDTH 

Traveling  at  near-transonic  speeds  (-400  ft/sec),  at  low  to  medium  altitudes,  an  aerial  explorer  flying  over  the  Martian 
landscape  faces  an  extraordinary  challenge  in  acquiring,  processing,  and  evaluating  (whether  for  navigation  or  scientific 
investigation)  terrain  imagery  data.  The  small,  fixed-wing  UAVs  flown  during  the  Haughton  field  demonstrations  are 
low-speed  aircraft  (35-50  kts)  with  relatively  low  bandwidth  requirements  (30fps  analog  FM  video  downlink  and  9600 
max  baud  aircraft  telemetry).  All  image  recognition  and  processing  was  performed  on  the  ground  for  these  flights. 
Therefore  only  a  partial  sense  of  the  bandwidth  issues  related  to  a  high-speed  Mars  airplane  can  be  gained  from  the 
Haughton  testing. 


9.  NAVIGATION 

Several  autonomous  mapping  flights  were  also  conducted  at  Devon  Island  using  the  BAT  UAV.  These  beyond  visual 
range  flights  used  GPS  navigation  to  follow  a  set  of  waypoints  that  were  developed  by  scouting  the  terrain  in  advance 
using  ATVs.  Figure  19  shows  a  representative  flight  plan  for  one  of  these  flights.  Figures  20  a-b  though  24  a-b  are  a 
series  of  matching  forward  and  downward-pointing  camera  images  recorded  during  the  execution  of  that  flight  plan. 
The  waypoints  on  this  plan  were  flown  counterclockwise  from  the  launch  to  the  landing  point  at  approximately  600  ft. 
AGL. 

An  imaging  profile  for  an  early  Mars  explorer  would  be  quite  different  and  would  require  significantly  more  autonomy. 
The  flight  would  probably  be  one  way  without  the  need  to  return  back  to  a  starting  point.  Without  GPS,  navigation 
would  rely  on  the  deployment  of  the  vehicle  over  a  general  area  of  interest  and  some  use  of  compass  tracking  from  that 
point.  The  aircraft  would  make  significant  use  of  on  board  sensors  and  processing  to  recognize  terrain  or  ground 
features  that  might  match  a  mission  goal  and  alter  the  course  of  the  aircraft  in  that  direction.  Further  exploration  of  an 
interesting  area  would  have  to  be  balanced  off  against  remaining  resources  and  any  mission  objectives  not  yet  attained. 


Figure  19.  -  Representative  2003  field  season  aerial  survey  flight  plan. 


Figure  20.  -  BAT  aerial  explorer  skirting  along  the  edges  of  the  Yon  Braun  Planitia  -  approaching  Marine  Peak  (a)  forward  (horizon) 
pointing  onboard  camera  (53  deg  FOY)  and  (b)  downward  pointing  (20  deg  FOV). 


Figure  21.  -  Midway  between  Marine  Peak  and  Pete  Conrad  Valley. 


Figure  22.  -  Entering  Pete  Conrad  Valley. 


Figure  24.  -  Flying  from  the  Airport  toward  the  Landing  Point. 

10.  NAVIGATION  VERSUS  INVESTIGATION 

As  in  surface  rovers,  the  array  of  imaging  sensors  onboard  aerial  explorers  will  need  to  play  dual  roles  as  navigation 
aids  as  well  as  essential  science  investigation  tools.  To  arrive  at  an  optimum-imaging  suite  is  no  easy  task.  Table  4. 
contrasts  the  relative  advantages  and  disadvantages  of  airborne  cameras  and  maneuvers  strategies. 


Table  4  -  Qualitative  Assessment  of  Camera  Pointing  &  Maneuvers  on  Imagery  Objectives 


Advantages 

Disadvantages 

Camera  Pointing 

Forward-pointing 

Good  situational  awareness.  Good  for  visual 
navigation. 

Not  as  good  for  high-quality  science  imagery. 

30-45  deg.  forward 

Good  compromise  camera  position. 

Perhaps  too  much  of  a  compromise  for  detailed  analysis  of  terrain; 
significant  post-processing  is  required  to  transform  images  to  a 
mosaic  map  of  the  planetary  surface. 

Downward-pointing 

Good  for  high-quality  science  imagery. 

Poor  situational  awareness  and  not  as  good  for  visual  navigation. 

Pan/tilt/zoom 

Potentially  use  fewer  cameras,  or  lower 
maneuvering  flight-path  deviations,  for  the 
same  imaging  coverage.  Can  acquire  off-axis 
(lateral)  images  while  maintaining  straight  and 
level  flight. 

Continue  to  examine  trades  between  number  and  position  of  fixed 
cameras  (with  a  need  for  intelligent  switching  between  them)  versus 
fewer  cameras  with  more  advanced  capabilities  such  as  pan,  tilt  and 
zoom,  but  perhaps  subjective  to  increased  concern  about  risk, 
reliability  and  control  complexity. 

Maneuvers 

Circling 

Found  to  provide  considerable  insight  into 
discrete  terrain  features  of  interest  such  as 
rock  formations.  Sequential  images  from 
successive  over  flights  can  allow  accurate 
three-dimensional  feature  extraction. 

Energy  and  time  intensive.  Has  to  be  a  priority,  high-value  terrain 
feature  of  interest  to  justify  performing,  particularly  for  planetary 
aerial  explorers. 

Tight  banking  turns 
or  shallow  rolls 

Time  efficient  means  to  acquire  horizon 
images  from  downward  pointing  cameras, 
allowing  for  a  partial  panoramic  view  of  the 
immediate  area.  Also  allows  imaging  tall  or 
steep  surfaces  such  as  canyon  walls  and  cliff 
faces. 

Energy  intensive. 

Zigzags 

Puts  to  the  test  assumptions  about  the  terrain 
being  flown  over;  i.e.  by  performing  periodic 
zigzags,  in  otherwise  straight  and  level  flight 
paths,  downward  pointing  cameras  can 
validate  whether  or  not  something  of  interest 
lies  just  off  the  main  flight  path. 

Somewhat  energy  and  time  intensive.  Conditional  logic  on  when, 
and  when  not  to,  perform  zigzags  and  other  maneuvers  may  be 
computationally  complex  or  intensive. 

Low  and  slow 

Could  be  an  efficient  means  of  coupling 
energy  management  with  bio-inspired  search 
and  find  strategies  2’ 4. 

Limitations,  because  of  high  stall  speed,  on  how  low  and  slow  a  Mars 
flyer  might  be  able  to  go.  This  problem  is  compounded  if  minimal 
advanced  data  is  available  for  terrain  being  over  flown.  In  that  case, 
there  could  be  increased  flight  safety  risk. 

Follow  borders 

Efficient  search  and  find  strategy;  e.g.  rather 
than  flying  over  the  barren  plain,  focus  on  the 
geologically  and  biologically  more  interesting 
outskirts. 

Could  be  very  energy  and  time  intensive  if  the  border  is  ill  defined  or 
circuitous  in  nature. 

11.  DERIVING  INSPIRATION  FROM  BIOLOGY 

The  natural  world  is  a  rich  source  of  problem-solving  approaches.  Like  many  other  aerospace  applications,  aerial 
explorers  can  benefit  from  bio-inspired  technologies.  In  particular,  a  considerable  amount  of  emphasis  has  been  placed 
on  examining  bio-inspired  mission  scenarios,  flight  “behaviors,”  and  decision-making  during  search-and-find  missions. 
The  IAV  project  has  had  strong  complementary  research  ties  with  the  “BEES  (Bio-inspired  Engineering  for  Exploration 
Systems)  for  Mars”  project5-6.  Aerial  imagery  and  telemetry  data  from  the  Haughton  2002  field  season  is  currently 
being  used  to  develop  and  refine  a  bio-inspired  vision- system  based  upon  a  cellular  neural-network  (CNN) 
semiconductor  device  and  Adaptive  Resonance  Theory  (ART)  firmware6. 

The  IAV  project’s  BAT  UAV  has  been  augmented  with  a  PC- 104  Mission  computer  to  complement  the  COTS  Flight 
computer  and  avionics.  This  will  allow  the  implementation  of  several  different  bio-inspired  vehicle  autonomy  search 
and  find  strategies.  The  2003  Haughton  field  season  afforded  the  IAV  project  an  opportunity  to  simulate  some  of  these 
search  and  find  strategies  using  the  COTS  BAT  UAV  system  and  a  network  of  ground-based  laptop  computers. 

12.  LESSONS  LEARNED 

Flight  tests  at  the  Devon  Island  Mars-analog  site  provided  many  opportunities  for  lessons  learned.  Overall,  our 
experiences  were  positive.  Even  though  still  in  the  earliest  stages  of  development,  the  power  of  aerial  robotic  field 
assistants  to  empower  terrestrial  field  scientists  (and  ultimately  planetary  scientists)  could  clearly  be  seen  from  the 


Haughton  demonstrations.  The  end  result  of  such  preliminary  work  could  well  be  a  close  working  partnership  between 
aerial  robots  and  scientists. 

We  also  encountered  several  challenges.  First,  it  was  clear  from  the  UAV  flight  tests  during  the  Haughton  field  seasons 
that  visibility  and  weather  conditions  can  have  a  large  impact  on  aerial  survey  productivity.  (Fog,  rain,  hail,  and  snow 
all  occurred  during  the  Arctic  summer.)  Adverse  local  conditions  could  equally  be  a  problem  on  Mars  where  suspended 
dust  particulates  in  the  atmosphere  (let  alone  dust  storms)  could  have  a  detrimental  effect  on  aerial  surveys.  Second, 
radio  interference  with  wireless  video  feed  from  the  UAV  was  still  a  significant  issue  at  Devon  Island  (from  the 
electronics  and  telecom  at  Base  Camp,  which  was  in  close  proximity  to  the  farthest  corner  of  the  Von  Braun  Planitia 
circumnavigation).  Third,  the  image  quality  of  the  two  low-cost  wireless  video  cameras  onboard  the  UAV  was  less  than 
desired.  Other  approaches  to  arrive  at  improved  imagery  data  will  be  developed  or  acquired. 

13.  FUTURE  DIRECTIONS 

Our  experiences  with  the  imaging  work  on  Devon  Island  in  field  seasons  2002  and  2003  will  be  crucial  for  preparing  for 
a  fully  mission-representative  set  of  flights  in  the  future.  In  addition  to  the  forward-  and  downward-pointing  cameras 
employed  to  date,  the  BAT  UAV  will  be  augmented  with  a  video  camera  having  both  zoom  and  pan-tilt  capabilities. 

Goals  for  future  testing  of  aerial  explorers  at  other  Mars-analog  sites  should  focus  on  the  following: 

A.  Coordinated  imagery  fusion:  wireless  video  from  a  radio  controlled  aircraft  relayed  through  the  BAT  (or  vice  versa), 
or  alternatively  through  relays  on  ATV's  (acting  as  rover  surrogates).  Vision  software  augmented  such  that  trainer 
aircraft  or  ATV  camera  feed  can  be  used  to  spot  tarps  for  BAT. 

B.  Perform  a  quantitative  assessment  of  various  search  and  find  strategies  by  seeding  multiple  targets  of  interest  or 
differing  search  areas.  This  should  hopefully  support  quantifiable  statements  such  as  3  of  4  targets  identified  within 
rough  terrain  search  area,  in  a  fifteen-minute  search,  with  a  given  strategy.) 

C.  Coordinate  with  a  field  astrobiologist  to  augment  his  or  her  field  work  with  the  BAT  and  other  assets.  (For  example, 

detailed  mosaic  mapping  of  rock  formation  faces  for  context.) 

D.  Support  a  1-2  day  scientific  trek  with  the  BAT,  performing  aerial  surveys  at  each  key  stopping  point.  The 
production  of  aerial  image  mosaics  would  be  a  key  deliverable  to  trek  organizers. 

E.  Distributed  sensor  work  (multiple  drop  pods,  different  types,  and  locations)  and  tailored  emplacement  of  sensors 
(hillsides,  canyons,  or  valley  walls).  Evaluate  the  application  of  ground  penetrators,  and  "tether-bots”  (Fig.  25). 

Ultimately  the  goal  of  the  IAV  project  is  to  transition  the  technologies  developed  to  other  NASA  programs  -  both 
planetary  and  terrestrial  science  missions. 


Figure  25.  -  Notional  deployment  and  operation  of  a  Tetherbot  concept. 


14.  CONCLUDING  REMARKS 

Many  issues  related  to  successfully  acquiring  aerial  imaging  data  of  a  type  and  quality  required  for  scientifically 
valuable  investigations  for  planetary  science  missions  were  discussed  in  this  paper.  There  is  considerable  electronic 
imaging  research  and  development  work  that  lies  ahead  in  order  to  elevate  the  future  development  of  robotic  planetary 
aerial  explorers  from  merely  technological  and  engineering  triumphs  to  profound  instruments  of  scientific  discovery. 
The  initial  efforts  discussed  within  this  paper  will  hopefully  help  begin  to  address  this  critical  technical  area. 
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